Learning Bayesian Belief Networks Based on the Minimum Description Length Principle : Basic Properties ∗
نویسنده
چکیده
SUMMARY This paper addresses the problem of learning Bayesian belief networks (BBN) based on the minimum description length (MDL) principle. First, we give a formula of description length based on which the MDL-based procedure learns a BBN. Secondly, we point out that the difference between the MDL-based and Cooper and Herskovits procedures is essentially in the priors rather than in the approaches (MDL and Bayesian), and recommend a class of priors from which the formula is obtained. Finally, we show as a merit of using the formula that a modified version of the Chow and Liu algorithm is obtained. The modified algorithm finds a set of trees rather than a spanning tree based on the MDL principle. key words: minimum description length principle, Bayesian belief network, Chow and Liu algorithm, Cooper and Herskovits procedure, MDL-based procedure, stochastic rule learning
منابع مشابه
Paper Learning Bayesian Belief Networks Based on the Minimum Description Length Principle: Basic Properties
SUMMARY This paper addresses the problem of learning Bayesian belief networks (BBN) based on the minimum description length (MDL) principle. First, we give a formula of description length based on which the MDL-based procedure learns a BBN. Secondly, we point out that the diierence between the MDL-based and Cooper and Herskovits procedures is essentially in the priors rather than in the approac...
متن کاملLearning Bayesian Belief Networks Based on the MDL Principle: An Efficient Algorithm Using the Branch and Bound Technique∗
In this paper, the computational issue in the problem of learning Bayesian belief networks (BBNs) based on the minimum description length (MDL) principle is addressed. Based on an asymptotic formula of description length, we apply the branch and bound technique to finding true network structures. The resulting algorithm searches considerably saves the computation yet successfully searches the n...
متن کاملProperties of Bayesian Belief Network Learning Algorithms
In this paper the behavior of various be lief network learning algorithms is stud ied. Selecting belief networks with cer tain minimallity properties turns out to be NP-hard, which justifies the use of search heuristics. Search heuristics based on the Bayesian measure of Cooper and Her skovits and a minimum description length (MDL) measure are compared with re spect to their properties for...
متن کاملLearning Bayesian Belief Networks Based on the Mdl Principle: an Ecient Algorithm Using the Branch and Bound Technique 1
In this paper, the problem of learning a Bayesian belief network (BBN) from given examples based on the minimum description length (MDL) principle is addressed. Given examples, the learning algorithm based on the MDL principle computes for each network the total of description length of the network and that of the examples given the network, and nds a network with the minimum value. We provide ...
متن کاملA Surface Water Evaporation Estimation Model Using Bayesian Belief Networks with an Application to the Persian Gulf
Evaporation phenomena is a effective climate component on water resources management and has special importance in agriculture. In this paper, Bayesian belief networks (BBNs) as a non-linear modeling technique provide an evaporation estimation method under uncertainty. As a case study, we estimated the surface water evaporation of the Persian Gulf and worked with a dataset of observations ...
متن کامل